Kernel Selection in Support Vector Machines Using Gram-Matrix Properties
نویسندگان
چکیده
We describe an approach to kernel selection in Support Vector Machines (SVMs) driven by the Gram matrix. Our study extracts properties from this matrix (e.g., Fisher’s discriminant, Bregman’s divergence) using different kernel functions (linear, polynomial, Gaussian, Laplacian, Bessel and ANOVARBF), and incorporates such properties as meta-features within a meta-learning framework. The goal is to predict the best kernel in SVMs. Results show how introducing a new metafeature, Distance Ratio, capturing inter-class and intra-class distances in the feature space, yields substantial improvements during kernel selection.
منابع مشابه
Separating Well Log Data to Train Support Vector Machines for Lithology Prediction in a Heterogeneous Carbonate Reservoir
The prediction of lithology is necessary in all areas of petroleum engineering. This means that to design a project in any branch of petroleum engineering, the lithology must be well known. Support vector machines (SVM’s) use an analytical approach to classification based on statistical learning theory, the principles of structural risk minimization, and empirical risk minimization. In this res...
متن کاملKernel/feature Selection for Support Vector Machines
Support Vector Machines are classifiers with architectures determined by kernel functions. In these proceedings we propose a method for selecting the best SVM kernel for a given classification problem. Our method searches for the best kernel by remapping the data via a kernel variant of the classical Gram-Schmidt orthonormalization procedure then using Fisher’s linear discriminant on the remapp...
متن کاملA Data Complexity Approach to Kernel Selection for Support Vector Machines
We describe a data complexity approach to kernel selection based on the behavior of polynomial and Gaussian kernels. Our results show how the use of a Gaussian kernel produces a gram matrix with useful local information that has no equivalent counterpart in polynomial kernels. By exploiting neighborhood information embedded by data complexity measures, we are able to carry out a form of meta-ge...
متن کاملA prediction distribution of atmospheric pollutants using support vector machines, discriminant analysis and mapping tools (Case study: Tunisia)
Monitoring and controlling air quality parameters form an important subject of atmospheric and environmental research today due to the health impacts caused by the different pollutants present in the urban areas. The support vector machine (SVM), as a supervised learning analysis method, is considered an effective statistical tool for the prediction and analysis of air quality. The work present...
متن کاملGenetic Algorithms and Kernel Matrix-based Criteria Combined Approach to Perform Feature and Model Selection for Support Vector Machines
Feature and model selection are in the center of attention of many researches because of their impact on classifiers’ performance. Both selections are usually performed separately but recent developments suggest using a combined GA-SVM approach to perform them simultaneously. This approach improves the performance of the classifier identifying the best subset of variables and the optimal parame...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014